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Background / Context: 

Description of prior research and its intellectual context. 

Computers have taken an increasingly prominent role in education around the world in recent 
years in developed and developing countries alike. As developing country governments have 
turned their focus from increasing enrollment to improving the quality of education in their 
schools, many have made access to computers a key component to their strategies (Trucano, 
2005). There is an emerging body of research now that shows that these strategies, which often 
come with a hefty price tag, have varied effects (Glewwe et ah, forthcoming). 

Rigorous evaluations have found that general computer use has had no or negative effects 
on math and language learning (Cristia et ah, 2012; Malamud & Pop-Eleches, 2011; and Barrera- 
Osorio & Linden, 2009). Several studies have found that specific software packages have also 
failed to have positive effects (Barrow, Markman & Rouse, 2007; Angrist & Lavy, 2002; and 
Rouse & Krueger, 2004), while others have had positive effects on learning outcomes (Roschelle 
et ah, 2010; Banerjee, Cole, Duflo & Linden, 2007; He, Linden & MacLeod, 2007; Rosas et ah, 
2003; and Campuzano et ah, 2009). 

This paper contributes to this literature by comparing the use of computer-assisted 
language learning software to traditional methods of English instruction in Costa Rica. We also 
compare two different software programs to one another. Because schools were randomly 
assigned to one of these two treatment groups or a control group, this research permits a rigorous 
comparison of the differential effects of two software programs, holding contextual factors 
constant. 

Purpose / Objective / Research Question / Focus of Study: 

Description of the focus of the research. 

Many developing countries have made English language learning a key component of their 
strategies to advance in the global economy (Pinon & Hay don, 2010). Costa Rica is one of these 
countries. This paper evaluates the effectiveness of technology as a tool to support learning 
English as a foreign language in primary schools in Costa Rica. By randomly assigning two 
software packages, DynEd English and Imagine Learning, we are able to identify differences in 
causal effects between the packages. 

This paper addresses the following research questions: Eirst, what is the impact of each of 
the two English language learning software programs on test scores, as compared to a teacher 
alone? Second, what is the magnitude of the effect of each program compared to the other? 

Third, do these effects vary by school-level baseline performance, students’ baseline test scores 
or gender? This paper contributes to the literature by evaluating the effectiveness of computers in 
an area where computers may provide a critical support to teachers in a curricular area (in this 
case, English) in which they are likely to have limited skills and, more generally, to the literature 
on technology’s causal effects on learning. 

Setting: 

Description of the research location. 

This research takes place in the Alajuela province of Costa Rica. Costa Rica has one of the most 
effective education systems in Latin America, as is evidenced by its performance on regional 
tests, which is above average for the region, even after accounting for the country’s income and 
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expenditure per pupil (PREAL, 2009). Nonetheless, the country’s ability to excel in English 
language instruction is limited by a limited supply of teachers qualified to teach English. The 
Costa Rican government is interested in the viability of computer-assisted language learning 
methods to address this short supply. 

Alajuela is immediately north of Costa Rica’s capital city, San Jose. With a level of 
urbanization, literacy rate and unemployment similar to the national average, the province is 
similar to the nation as a whole (INEC, 2013). The schools participating in the study are 
distributed throughout Alajuela province. 

Population / Participants / Subjects: 

Description of the participants in the study: who, how many, key features, or characteristics. 

rd 

The sample is comprised of 866 students who were enrolled in 3 grade in the first year of the 
two-year study; the sample is approximately evenly divided among the DynEd software group, 
the Imagine Eearning group and a control group. The sample suffered significant attrition. 
Restricted to students who are not missing any test score data, the sample falls to 498 students/ 
however, there is no significant difference in attrition by treatment group. 

Intervention / Program / Practice: 

Description of the intervention, program, or practice, including details of administration and duration. 

Schools assigned to the control group continued teaching English as they had in previous years 
according to Ministry of Education guidelines. Schools assigned to either of the treatment groups 
received a laptop and headset for every third grade student and either the DynEd or Imagine 
Eearning software. The intervention lasted two years, from 2010 to 2011. In the first year, 
students in the treatment groups used computers every day for English instruction, while in the 
second year, they used the computers three days a week, and worked with their teachers the other 
two days. Students in the control group worked with their English teacher every day both years. 

The two software programs are similar in many respects. Both use multi-media content 
and present material that is appropriate to students’ individual levels. Whereas DynEd presents 
all its material only in English, the Imagine Eearning software introduces early concepts in the 
student’s native language. Key characteristics of each program are presented in Table 1. 

Research Design: 

Description of the research design. 

This is a randomized controlled trial. The study implementation team (distinct from the analysis 
team) first identified a sample of primary schools that met key criteria for inclusion: access to 
electricity, having an English teacher who was not involved in any other pilot, and having a 
minimum of five students enrolled in the third grade. After conducting the original 
randomization, however, the implementation team learned that numerous schools did not fulfill 
these criteria. Unfortunately, the team’s response was not consistent across cross. Schools that 
did not have an English teacher in the control group were replaced with new schools that did 
have an English teacher, but schools without an English teacher in either treatment group were 
left in the sample. This introduced a systematic difference between the two groups; the treatment 
groups, which included schools without English teachers, were smaller, more rural and had less 
prior experience with English on average. 

To address this problem, to estimate the treatment effect of either software, as compared 
to the control group, we restrict the sample for analysis to the sample of schools from the original 
randomization that did have English teachers; this smaller sample does not suffer from the 
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systematic differences that the full sample does. In this restricted sample, all schools have 
English teachers. We use the full sample, however, when comparing the two software programs 
to one another, as the criteria for inclusion were applied in the same way to these two groups. 
This sample includes schools with and without English teachers. 

In the restricted sample, there are no significant differences in baseline test scores 
between the treatment and control groups, although there is a significant difference in the percent 
of the sample that is female (DynEd has fewer girls). In the full sample, which is only used to 
compare the two treatment groups, there is no significant difference in baseline test scores 
between the two groups, but there is a difference in gender. Baseline characteristics for the full 
and restricted samples are presented in Table 2. 

Data Collection and Analysis: 

Description of the methods for collecting and analyzing data. 

Program effects were measured as changes in student scores on the Woodcock-Munoz Eanguage 
Survey-Revised (WMES-R). Students took this test in three rounds of data collection: at the 
beginning and end of third grade (the 2010 school year), and at the end of fourth grade (the 2011 
school year). This test is a norm-referenced, standardized instrument that measures language 
proficiency in reading, writing, listening and comprehension. The instrument has strong 
concurrent validity with other standardized tests that measure oral language (the IDEA 
Proficiency Test and the Eanguage Assessment Scale), intelligence (Wechsler Adult Intelligence 
Scale) and academic achievement (Wide Range Achievement Test and Woodcock-Johnson III 
Tests of Achievement) (Woodcock et ah, 2005). The test includes picture vocabulary, verbal 
analogies, understanding directions, and story recall subtests, generating scores for each of these 
subtests as well as an oral language score, which combines items from the other subtests that are 
relevant to oral language skills. With the exception of gender, data on student characteristics are 
not available. Test scores are standardized based on control group baseline scores, so treatment 
effects have an effect size interpretation. 

To address baseline differences, a difference in difference model is used to estimate the 
treatments’ effects on English language proficiency at the end of the first year (round 2) and 
second year (round 3) of the study. 

The difference in difference model controls for time-invariant differences among the two 
treatment groups and the control group, as well as common time trends that are found in both the 
treatment groups and the control group. This is seen in equation (1), where Testip is the test score 
for student i in school j in time t, t is a time dummy variable indicating whether the observation 
is post-treatment (in this case, post-treatment could be for round 2 or round 3), Tj indicates 
whether the student is in a school that is in the treatment group (this could be either DynEd or 
Imagine Eearning), Tj*t interacts the treatment and time dummies, and Stp is a mean-zero error 
term for individual i in school j and time t. The coefficient on the interaction of treatment and 
time indicator, /3s, represents the estimated treatment effect. 

Testijt = /3o + pit -t- P2Tj + psTpt Sp ( 1 ) 

This equation is estimated for effects on test score growth from baseline to round 2 and baseline 
to round 3, comparing each treatment group to the control group as well as to one another. 
Standard errors are clustered at the school level for all estimates. 
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Findings / Results: 

Description of the main findings with specific details. 

Table 3 presents standardized test scores by wave for each group for the full sample and the 
restricted sample. Tables 4a, 4b and 4c present main effects. Panel A in each table represents the 
treatment effect at the end of the first year, while Panel B presents the treatment effect at the end 
of the second year. The coefficient on the time variable (t in the tables) represents the change in 
test scores for students in the control group, while the coefficient on the treatment interacted with 
the time variable represents the treatment effect. These tables show that DynEd has significant 
positive effects compared to the control group, while Imagine Learning has no positive effects. 
When comparing DynEd against Imagine Learning, DynEd has a significantly greater effect on 
several subtests in the first and second years. Imagine does not have a significantly greater effect 
on any subtest. DynEd’s effects are greater in the first year of the study when students work with 
the software five days a week then in the second year, when they work with the software three 
days a week. 

Tables 5 through 7 present the results of subgroup analysis to test whether treatment 
effects varied for schools with lower average baseline test scores, students with lower baseline 
test scores, or for girls. In these tables, the coefficient on the treatment interacted with time and 
the subgroup (e.g., t*DynEd*Low) represent the difference in treatment effect for the subgroup 
as compared to the effect for those that are not members of the subgroup. Eor example, the 
coefficient on t*DynEd*Low represents the difference in DynEd’s effect for low students and 
DynEd’s effect for higher scoring students. The subgroup analysis reveals that Dyned’s effects 
did not vary significantly by schools’ baseline test scores, although the effect was significantly 
greater on one subtest in the second year for students with low baseline test scores. In contrast. 
Imagine Learning’s effects were significantly lower in low-scoring schools and for low-scoring 
students on some subtests in both years. Neither software’s effects varied significantly by 
gender, but Dyned’s advantage over Imagine is significantly greater for girls on some subtests in 
the second year. 

Conclusions: 

Description of conclusions, recommendations, and limitations based on findings. 

The main finding of this research is that academic software can be an effective learning tool, but 
that this depends on the software. Previous research has already shown that technology can be 
effective in some cases and ineffective in others. One of this paper’s contributions is to show that 
these heterogeneous effects are not simply the product of using technology in different contexts 
(although that is likely to be important as well). By randomly assigning two different software 
packages to students in similar schools, this research has shown that the type of technology used 
matters, holding other factors constant. Furthermore, technology’s effectiveness also depends on 
student characteristics like baseline abilities and gender. 

This research also contributes to the literature that shows that technology can be an 
effective teaching aid. Students working with the DynEd software learned 53% more than 
students in the control group, who worked with teachers alone. Euture research should explore 
the cost implications of using computers and software to teach English or other subjects in which 
teachers may lack skills, as compared to alternative solutions, such as expanded teacher training. 
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Appendix B. Tables and Figures 
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Table 1: Characteristics of DynEd and Imagine Learning Softwares 



DynEd 

Imagine Learning 

Overall approach 

• “Non-linear,” blended approach 

• Level of lessons adapt to each 
student’s learning style and pace 

• Type of lessons adapts to students’ 
learning style 

• “Linear” teaching approach 

• Lessons adapt to each students’ 
learning style and pace 

Skill focus 

• Listening, speaking, reading, writing 

• Focus on listening and speech 
recognition 

• Sight word vocabulary 

• Decoding new words 

Activities 

• Learning English songs 

• Games 

• Watching videos of dialogue 

• Playback of student speech compared 
to correct pronunciation 

• Learning English songs 

• Video game-like presentation of 
activities 

• W riting in j ournals 

• Recording conversations 

Supplementary materials 

• Worksheets 

• None 

Teacher training 

• Teacher training online 

• None 

Feedback for teachers on 
student performance 

• Teachers track progress online 

• Students take placement and mastery 
tests 

• Teachers track progress online 

Use of native language 

• None - immersion approach 

• “Fade” approach explains early 
vocabulary and concepts in Spanish 

Average time spent per 
week 

• 67 minutes 

• 127 minutes 


Sources: DynEd website. Imagine Learning website. Source for time spent per week: project documentation. 
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Table 2: 

Baseline Equivalence by Group 



Panel A: Full Sample 

Full sample 

Control 

DynEd 

Imagine 

Dyned - 
Control 

Imagine - 
Control 

DynEd - 
Imagine 

Female 

0.539 

0.398 

0.527 

-0.141** 

-0.012 

-0.130** 


(0.500) 

(0.491) 

(0.501) 

(0.056) 

(0.057) 

(0.063) 

Picture Vocabulary 

0.073 

-0.175 

-0.286 

-0.248 

-0.359* 

0.111 


(1.005) 

(0.895) 

(1.044) 

(0.182) 

(0.190) 

(0.217) 

Verbal Analogies 

0.090 

-0.115 

-0.251 

-0.205 

-0.341* 

0.136 


(1.044) 

(0.883) 

(0.699) 

(0.199) 

(0.176) 

(0.153) 

Understanding Directions 

0.213 

-0.158 

-0.163 

-0.371* 

-0.376* 

0.005 


(0.936) 

(1.025) 

(0.992) 

(0.200) 

(0.200) 

(0.234) 

Story Recall 

-0.012 

-0.127 

-0.224 

-0.116 

-0.212 

0.097 


(0.964) 

(1.077) 

(1.074) 

(0.184) 

(0.224) 

(0.207) 

Oral Language 

0.127 

-0.189 

-0.287 

-0.316 

-0.414* 

0.098 


(0.992) 

(0.943) 

(0.944) 

(0.204) 

(0.209) 

(0.222) 

Number of students 

167 

166 

165 

333 

332 

331 

Number of schools 

23 

23 

24 

46 

47 

47 

Panel B; Restricted Sample^ 

(Only Schools with English Teachers; No Replacement Schools) 


Full sample 

Control 

DynEd 

Imagine 

Dyned - 
Control 

Imagine - 
Control 

DynEd - 
Imagine 

Female 

0.542 

0.364 

0.477 

-0.178*** 

-0.065 

-0.112 


(0.500) 

(0.483) 

(0.502) 

(0.063) 

(0.060) 

(0.067) 

Picture Vocabulary 

0.043 

0.048 

-0.095 

0.005 

-0.138 

0.143 


(1.032) 

(0.877) 

(0.966) 

(0.217) 

(0.198) 

(0.231) 

Verbal Analogies 

0.153 

-0.022 

-0.181 

-0.174 

-0.334 

0.160 


(1.063) 

(0.940) 

(0.651) 

(0.247) 

(0.214) 

(0.193) 

Understanding Directions 

0.134 

-0.018 

0.085 

-0.151 

-0.049 

-0.103 


(0.928) 

(1.012) 

(0.778) 

(0.240) 

(0.188) 

(0.242) 

Story Recall 

0.052 

0.013 

0.008 

-0.039 

-0.043 

0.004 


(0.921) 

(1.023) 

(0.978) 

(0.197) 

(0.250) 

(0.232) 

Oral Language 

0.120 

0.003 

-0.053 

-0.117 

-0.173 

0.056 


(0.991) 

(0.934) 

(0.752) 

(0.244) 

(0.206) 

(0.225) 

Number of students 

131 

118 

86 

249 

217 

204 

Number of schools 

16 

13 

10 

29 

26 

23 


All variables have been standardized by the standard deviation and mean values from wave 1. The sample is 
restricted to individuals that are not missing test score data for any of the three waves. For means, standard 
deviations are presented in parentheses. For differences in means, standard errors are presented in parentheses and 
are adjusted for school-level clustering. * p < 0.1; ** p < 0.05; *** p < 0.01 . 
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Table 3: Mean Test Scores by Group and Time Period 


Panel A: Full Sample 


Control 

DynEd 

Imagine 


n=167 

n=166 

n=165 

Panel A.l: Baseline 

Picture Vocabulary 

0.073 

-0.175 

-0.286 

Verbal Analogies 

0.090 

-0.115 

-0.251 

Understanding Directions 

0.213 

-0.158 

-0.163 

Story Recall 

-0.012 

-0.127 

-0.224 

Oral Language Composite 

0.127 

-0.189 

-0.287 

Panel A.2: End of Year One 

Picture Vocabulary 

0.740 

0.962 

0.442 

Verbal Analogies 

0.216 

0.030 

-0.001 

Understanding Directions 

0.640 

0.877 

0.317 

Story Recall 

0.693 

0.513 

0.525 

Oral Language Composite 

0.726 

0.796 

0.400 

Panel A. 3 

: End of Year Two 


Picture Vocabulary 

1.094 

1.157 

0.775 

Verbal Analogies 

0.471 

0.222 

0.215 

Understanding Directions 

1.011 

1.044 

0.644 

Story Recall 

1.095 

0.915 

1.033 

Oral Language Composite 

1.160 

1.083 

0.824 

Panel B; ^ 

Restricted Sample 



Control 

DynEd 

Imagine 


n=131 

n=118 

n=86 

Panel B.l: Baseline 

Picture Vocabulary 

0.043 

0.048 

-0.095 

Verbal Analogies 

0.153 

-0.022 

-0.181 

Understanding Directions 

0.134 

-0.018 

0.085 

Story Recall 

0.052 

0.013 

0.008 

Oral Language Composite 

0.120 

0.003 

-0.053 

Panel B.2: End of Year One 

Picture Vocabulary 

0.676 

1.017 

0.587 

Verbal Analogies 

0.231 

0.014 

0.167 

Understanding Directions 

0.582 

0.938 

0.431 

Story Recall 

0.724 

0.575 

0.627 

Oral Language Composite 

0.693 

0.849 

0.565 

Panel B.3 

: End of Year Two 


Picture Vocabulary 

0.984 

1.274 

1.049 

Verbal Analogies 

0.446 

0.359 

0.509 

Understanding Directions 

0.950 

1.104 

0.941 

Story Recall 

1.019 

0.934 

1.220 

Oral Language Composite 

1.072 

1.193 

1.163 


All test scores are standardized by the restricted sample control 
group’s baseline test scores. Both samples are restricted to the 
sample of children with test score data for all three rounds. 
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Table 4a: Effects of Dyned vs. Control 


Panel A: End of Year One (n=249) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.043 

0.153 

0.134 

0.052 

0.120 


(0.128) 

(0.187) 

(0.132) 

(0.155) 

(0.160) 

t 

0.632*** 

0.078 

0.449*** 

0.673*** 

0.573*** 


(0.133) 

(0.209) 

(0.110) 

(0.209) 

(0.135) 

Dyned 

0.005 

-0.174 

-0.151 

-0.039 

-0.117 


(0.217) 

(0.247) 

(0.240) 

(0.197) 

(0.244) 

Dyned*t 

0.337* 

-0.043 

0.507*** 

-0.110 

0.273 


(0.177) 

(0.276) 

(0.179) 

(0.249) 

(0.195) 

R-squared 

0.153 

0.010 

0.135 

0.111 

0.128 

Panel B: End of Year Two (n=249) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.043 

0.153 

0.134 

0.052 

0.120 


(0.128) 

(0.187) 

(0.132) 

(0.155) 

(0.160) 

t 

0.941*** 

0.294* 

0.816*** 

0.967*** 

0.952*** 


(0.111) 

(0.164) 

(0.097) 

(0.211) 

(0.146) 

Dyned 

0.005 

-0.174 

-0.151 

-0.039 

-0.117 


(0.217) 

(0.247) 

(0.240) 

(0.197) 

(0.244) 

Dyned*t 

0.284 

0.087 

0.306 

-0.046 

0.237 


(0.196) 

(0.249) 

(0.186) 

(0.237) 

(0.198) 

R-squared 

0.256 

0.032 

0.225 

0.226 

0.253 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the restricted sample of students without missing test score data at schools with English teachers from 
the original randomization. Standard errors, adjusted for school-level clustering, are presented in parentheses. * 
p<.l; ** p<.05; *** p<.01. 
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Table 4b: Effects of Imagine Learning vs. Control 


Panel A: End of Year One (n=217) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.043 

0.153 

0.134 

0.052 

0.120 


(0.129) 

(0.188) 

(0.132) 

(0.155) 

(0.161) 

t 

0.632*** 

0.078 

0.449*** 

0.673*** 

0.573*** 


(0.133) 

(0.209) 

(0.110) 

(0.210) 

(0.135) 

Imagine 

-0.138 

-0.334 

-0.049 

-0.043 

-0.173 


(0.198) 

(0.215) 

(0.188) 

(0.251) 

(0.206) 

Imagine*t 

0.049 

0.270 

-0.102 

-0.054 

0.045 


(0.152) 

(0.282) 

(0.159) 

(0.286) 

(0.166) 

R-squared 

0.100 

0.021 

0.049 

0.125 

0.097 

Panel B: End of Year Two (n=217) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.043 

0.153 

0.134 

0.052 

0.120 


(0.129) 

(0.188) 

(0.132) 

(0.155) 

(0.161) 

t 

0.941*** 

0.294* 

0.816*** 

0.967*** 

0.952*** 


(0.111) 

(0.165) 

(0.097) 

(0.212) 

(0.146) 

Imagine 

-0.138 

-0.334 

-0.049 

-0.043 

-0.173 


(0.198) 

(0.215) 

(0.188) 

(0.251) 

(0.206) 

Imagine*t 

0.203 

0.397 

0.040 

0.245 

0.263 


(0.189) 

(0.235) 

(0.161) 

(0.308) 

(0.193) 

R-squared 

0.208 

0.059 

0.176 

0.300 

0.245 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the restricted sample of students without missing test score data at schools with English teachers from 
the original randomization. Standard errors, adjusted for school-level clustering, are presented in parentheses. * 
p<.l; ** p<.05; *** p<.01. 
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Table 4c: Effects of Dyned vs. Imagine Learning 


Panel A: End of Year One (n=331) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

-0.102 

-0.120 

0.003 

-0.022 

-0.070 


(0.158) 

(1.000) 

(0.161) 

(0.160) 

(0.162) 

t 

0.726*** 

0.287** 

0.466*** 

0.698*** 

0.696*** 


(0.092) 

(0.138) 

(0.090) 

(0.136) 

(0.086) 

Dyned 

0.111 

0.156 

0.005 

0.090 

0.099 


(0.217) 

(0.176) 

(0.228) 

(0.193) 

(0.225) 

Dyned *t 

0.409*** 

-0.120 

0.540*** 

-0.101 

0.302* 


(0.140) 

(0.225) 

(0.157) 

(0.171) 

(0.155) 

R-squared 

0.231 

0.017 

0.157 

0.115 

0.193 

Panel B: End of Year Two (n=331) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

-0.102 

-0.120 

0.003 

-0.022 

-0.070 


(0.158) 

(0.0996) 

(0.161) 

(0.160) 

(0.162) 

t 

1.059*** 

0.535*** 

0.784*** 


1.125*** 


(0.097) 

(0.121) 

(0.090) 

(0.141) 

(0.085) 

Dyned 

0.111 

0.156 

0.005 

0.090 

0.099 


(0.217) 

(0.176) 

(0.228) 

(0.193) 

(0.225) 

Dyned *t 

0.270* 

-0.148 

0.383** 

-0.201 

0.163 


(0.158) 

(0.217) 

(0.166) 

(0.168) 

(0.147) 

R-squared 

0.289 

0.052 

0.225 

0.284 

0.298 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the full sample of students without missing test score data. Standard errors, adjusted for school-level 
clustering, are presented in parentheses. * p<.l; ** p<.05; *** p<.01. 
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Table 5a: Effects of Dyned vs. Control for Low-Performing Schools 


Panel A: End of Year One (n=249) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.334* 

0.575** 

0.454*** 

0.329** 

0.527*** 


(0.179) 

(0.236) 

(0.153) 

(0.130) 

(0.190) 

t 

0.613*** 

-0.271 

0.241*** 

0.362* 

0.318** 


(0.157) 

(0.304) 

(0.057) 

(0.190) 

(0.130) 

Dyned 

0.084 

-0.347 

-0.078 

-0.119 

-0.128 


(0.240) 

(0.322) 

(0.252) 

(0.154) 

(0.248) 

t*Dyned 

0.195 

0.226 

0.492** 

0.033 

0.327 


(0.206) 

(0.420) 

(0.197) 

(0.256) 

(0.239) 

Low school 

-0.681*** 

-0.987*** 

-0.750*** 

-0.650** 

-0.953*** 


(0.206) 

(0.260) 

(0.189) 

(0.280) 

(0.214) 

t*Low 

0.046 

0.816** 

0.485** 

0.726* 

0.598** 


(0.280) 

(0.345) 

(0.212) 

(0.412) 

(0.257) 

Dyned*Low 

-0.289 

0.333 

-0.283 

0.133 

-0.087 


(0.291) 

(0.357) 

(0.319) 

(0.364) 

(0.310) 

t*Dyned*Low 

0.377 

-0.607 

0.098 

-0.289 

-0.068 


(0.359) 

(0.464) 

(0.311) 

(0.485) 

(0.348) 


0.265 

0.108 

0.245 

0.160 

0.270 

Panel A: End of Year Two (n=249) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.334* 

0.575** 

0.454*** 

0.329** 

0.527*** 


(0.179) 

(0.236) 

(0.153) 

(0.130) 

(0.190) 

t 

0.781*** 

0.009 

0.662*** 1 

0.583*** 

0.666*** 


(0.131) 

(0.197) 

(0.073) 

(0.178) 

(0.138) 

Dyned 

0.084 

-0.347 

-0.078 

-0.119 

-0.128 


(0.240) 

(0.322) 

(0.252) 

(0.154) 

(0.248) 

t*Dyned 

0.203 

0.299 

0.140 

0.238 

0.276 


(0.240) 

(0.347) 

(0.180) 

(0.217) 

(0.213) 

Low school 

-0.681*** 

-0.987*** 

-0.750*** 

-0.650** 

-0.953*** 


(0.206) 

(0.260) 

(0.189) 

(0.280) 

(0.214) 

t*Low 

0.374* 

0.666** 

0.361* 

0.898** 

0.670** 


(0.212) 

(0.289) 

(0.196) 

(0.376) 

(0.258) 

Dyned*Low 

-0.289 

0.333 

-0.283 

0.133 

-0.087 


(0.291) 

(0.357) 

(0.319) 

(0.364) 

(0.310) 

t*Dyned*Low 

0.258 

-0.477 

0.478 

-0.636 

-0.020 


(0.344) 

(0.441) 

(0.306) 

(0.435) 

(0.327) 


0.337 

0.133 

0.328 

0.276 

0.369 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the restricted sample of students without missing test score data at schools with English teachers from 
the original randomization. Standard errors, adjusted for school-level clustering, are presented in parentheses. * 
p<.l; ** p<.05; *** p<.01. 
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Table 5b: Effects of Imagine Learning vs. Control for Low-Performing Schools 



Panel A: 

End of Year One (n=217) 



Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.334* 

0.575** 

0.454*** 

0.329** 

0.527** 


(0.179) 

(0.237) 

(0.153) 

(0.131) 

(0.190) 

t 

0.613*** 

-0.271 

0.241*** 

0.362* 

0.318** 


(0.158) 

(0.304) 

(0.057) 

(0.190) 

(0.130) 

Imagine 

-0.209 

-0.653** 

-0.202 

0.021 

-0.328 


(0.237) 

(0.261) 

(0.173) 

(0.200) 

(0.198) 

t*Imagine 

0.027 

0.744* 

0.091 

-0.017 

0.251 


(0.184) 

(0.396) 

(0.126) 

(0.264) 

(0.160) 

Low school 

-0.681*** 

-0.987*** 

-0.750*** 

-0.650** 

-0.953*** 


(0.207) 

(0.261) 

(0.190) 

(0.281) 

(0.214) 

t*Low 

0.046 

0.816** 

0.485** 

0.726* 

0.598** 


(0.281) 

(0.346) 

(0.213) 

(0.413) 

(0.258) 

Imagine *Low 

0.155 

0.740** 

0.350 

-0.167 

0.352 


(0.323) 

(0.336) 

(0.301) 

(0.444) 

(0.278) 

t*Imagine*Low 

0.053 

-1.116** 

-0.452 

-0.074 

-0.480 


(0.319) 

(0.497) 

(0.328) 

(0.542) 

(0.330) 


0.179 

0.109 

0.117 

0.201 

0.206 


Panel A: 

End of Year Two (n=217) 



Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.334* 

0.575** 

0.454*** 

0.329** 

0.527** 


(0.179) 

(0.237) 

(0.153) 

(0.131) 

(0.190) 

t 

0.781*** 

0.009 

0.662*** 

0.583*** 

0.666*** 


(0.131) 

(0.198) 

(0.073) 

(0.178) 

(0.138) 

Dyned 

-0.209 

-0.653** 

-0.202 

0.021 

-0.328 


(0.237) 

(0.261) 

(0.173) 

(0.200) 

(0.198) 

t*Dyned 

0.371** 

0.663* 

0.240 

0.304 

0.492** 


(0.148) 

(0.330) 

(0.172) 

(0.321) 

(0.201) 

Low school 

-0.681*** 

-0.987*** 

-0.750*** 

-0.650** 

-0.953*** 


(0.207) 

(0.261) 

(0.190) 

(0.281) 

(0.214) 

t*Low 

0.374* 

0.666** 

0.361* 

0.898** 

0.670** 


(0.213) 

(0.290) 

(0.197) 

(0.377) 

(0.259) 

Dyned*Low 

0.155 

0.740** 

0.350 

-0.167 

0.352 


(0.323) 

(0.336) 

(0.301) 

(0.444) 

(0.278) 

t*Dyned*Low 

-0.394 

-0.623 

-0.470 

-0.123 

-0.531 


(0.420) 

(0.424) 

(0.336) 

(0.525) 

(0.361) 


0.263 

0.135 

0.250 

0.371 

0.332 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the restricted sample of students without missing test score data at schools with English teachers from 
the original randomization. Standard errors, adjusted for school-level clustering, are presented in parentheses. * 
p<.l; ** p<.05; *** p<.01. 
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Table 5c: Effects of Dyned vs. Imagine Learning for Low-Performing Schools 


Panel A: End of Year One (n=331) 

Variables 

Picture 

Vocabulary 

Verbal 

Analogies 

Und. 

Directions 

Story Recall 

Oral 

Language 

Constant 

0.422** 

0.156 

0.512*** 

0.347*** 

0.478*** 


(0.179) 

(0.103) 

(0.137) 

(0.118) 

(0.125) 

t 

0.536*** 

0.260 

0.256*** 

0.489*** 

0.488*** 


(0.100) 

(0.221) 

-0.092 

(0.141) 

-0.073 

Dyned 

0.048 

0.268 

-0.001 

0.017 

0.088 


(0.234) 

(0.240) 

(0.213) 

(0.144) 

(0.184) 

t*Dyned 

0.391** 

-0.298 

0.486*** 

-0.091 

0.230 


(0.158) 

(0.365) 

(0.174) 

(0.197) 

(0.182) 

Low school 

-1.109*** 

-0.584*** 

-1.076*** 

-0.780*** 

-1.160*** 


(0.202) 

(0.154) 

(0.198) 

(0.272) 

(0.191) 

t*Low 

0.403** 

0.058 

0.445*** 

0.442* 

0.441*** 


(0.171) 

(0.272) 

(0.152) 

(0.257) 

(0.149) 

Dyned*Low 

0.101 

-0.263 

-0.023 

0.134 

-0.012 


(0.276) 

(0.279) 

(0.292) 

(0.321) 

(0.267) 

t*Dyned*Low 

0.051 

0.390 

0.131 

-0.008 

0.171 


(0.260) 

(0.445) 

(0.287) 

(0.323) 

(0.287) 


0.405 

0.113 

0.328 

0.196 

0.405 

Panel A: End of Year Two (n=331) 

Variables 

Picture 

Vocabulary 

Verbal 

Analogies 

Und. 

Directions 

Story Recall 

Oral 

Language 

Constant 

0.422** 

0.156 

0.512*** 

0.347*** 

0.478*** 


(0.179) 

(0.103) 

(0.137) 

(0.118) 

(0.125) 

t 

1.027*** 

0.545*** 

0.689*** 

0.917*** 

1.019*** 


(0.0968) 

(0.195) 

(0.124) 

(0.160) 

(0.105) 

Dyned 

0.0480 

0.268 

-0.000574 

0.0173 

0.0876 


(0.234) 

(0.240) 

(0.213) 

(0.144) 

(0.184) 

t*Dyned 

0.0715 

-0.318 

0.0910 

-0.146 

-0.0548 


(0.199) 

(0.363) 

(0.182) 

(0.187) 

(0.178) 

Low school 

-1.109*** 

-0.584*** 

-1.076*** 

-0.780*** 

-1.160*** 


(0.202) 

(0.154) 

(0.198) 

(0.272) 

(0.191) 

t*Low 

0.0682 

-0.0222 

0.201 

0.539** 

0.225 


(0.201) 

(0.239) 

(0.171) 

(0.253) 

(0.164) 

Dyned *Low 

0.101 

-0.263 

-0.0225 

0.134 

-0.0121 


(0.276) 

(0.279) 

(0.292) 

(0.321) 

(0.267) 

t*Dyned*Low 

0.436 

0.372 

0.645** 

-0.101 

0.484* 


(0.297) 

(0.420) 

(0.290) 

(0.306) 

(0.261) 


0.459 

0.147 

0.399 

0.353 

0.486 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the full sample of students without missing test score data. Standard errors, adjusted for school-level 
clustering, are presented in parentheses. * p<.l; ** p<.05; *** p<.01. 
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Table 6a: Effects of Dyned vs. Control for Low-Performing Students 


Panel A: End of Year One (n=249) 

Variables 

Picture 

Vocabulary 

Verbal 

Analogies 

Und. 

Directions 

Story Recall 

Oral 

Language 

Constant 

0.724*** 

0.912*** 

0.804*** 

0.671*** 

0.972*** 


(0.153) 

(0.270) 

(0.105) 

(0.092) 

(0.157) 

t 

0.518*** 

-0.186 

0.224*** 

0.274* 

0.300*** 


(0.170) 

(0.319) 

(0.070) 

(0.136) 

(0.107) 

Dyned 

0.064 

-0.236 

-0.117 

0.044 

-0.068 


(0.201) 

(0.366) 

(0.197) 

(0.118) 

(0.205) 

t*Dyned 

0.180 

-0.146 

0.345* 

-0.157 

0.123 


(0.207) 

(0.457) 

(0.186) 

(0.214) 

(0.224) 

Low student 

-1.183*** 

-1.352*** 

-1.221*** 

-1.039*** 

-1.499*** 


(0.164) 

(0.271) 

(0.155) 

(0.205) 

(0.169) 

t*Low 

0.269 

0.658** 

0.504*** 

0.841** 

0.668*** 


(0.185) 

(0.299) 

(0.146) 

(0.306) 

(0.189) 

Dyned*Low 

-0.031 

0.190 

0.036 

-0.091 

0.014 


(0.213) 

(0.366) 

(0.239) 

(0.248) 

(0.226) 

t*Dyned*Low 

0.320 

0.156 

0.280 

0.049 

0.280 


(0.279) 

(0.420) 

(0.237) 

(0.364) 

(0.278) 


0.380 

0.185 

0.365 

0.305 

0.455 

Panel B: End of Year Two (n=249) 

Variables 

Picture 

Vocabulary 

Verbal 

Analogies 

Und. 

Directions 

Story Recall 

Oral 

Language 

Constant 

0.724*** 

0.912*** 

0.804*** 

0.671*** 

0.972*** 


(0.153) 

(0.270) 

(0.105) 

(0.092) 

(0.157) 

t 

0.750*** 

0.042 

0.591*** 

0.515*** 

0.644*** 


(0.120) 

(0.194) 

(0.078) 

(0.124) 

(0.103) 

Dyned 

0.064 

-0.236 

-0.117 

0.044 

-0.068 


(0.201) 

(0.366) 

(0.197) 

(0.118) 

(0.205) 

t*Dyned 

0.126 

0.013 

0.097 

-0.007 

0.091 


(0.218) 

(0.339) 

(0.185) 

(0.164) 

(0.182) 

Low student 

-1.183*** 

-1.352*** 

-1.221*** 

-1.039*** 

-1.499*** 


(0.164) 

(0.271) 

(0.155) 

(0.205) 

(0.169) 

t*Low 

0.451** 

0.703** 

0.480*** 

Q 

0.763*** 


(0.176) 

(0.297) 

(0.123) 

(0.301) 

(0.177) 

Dyned*Low 

-0.031 

0.190 

0.036 

-0.091 

0.014 


(0.213) 

(0.366) 

(0.239) 

(0.248) 

(0.226) 

t*Dyned*Low 

0.307 

0.130 

0.396* 

-0.154 

0.262 


(0.210) 

(0.419) 

(0.225) 

(0.343) 

(0.223) 


0.448 

0.200 

0.446 

0.403 

0.528 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This analysis uses 
the restricted sample of students without missing test score data at schools with English teachers from the original randomization. 
Standard errors, adjusted for school-level clustering, are presented in parentheses. * p<.l; ** p<.05; *** p<.01. 
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Table 6b: Effects of Imagine Learning vs. Control for Low-Performing Students 



Panel A: 

End of Year One (n=217) 



Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.724*** 

0.912*** 

0.804*** 

0.671*** 

0.972*** 


(0.154) 

(0.271) 

(0.105) 

(0.092) 

(0.158) 

t 

0.518*** 

-0.186 

0.224*** 

0.274* 

0.300*** 


(0.170) 

(0.320) 

(0.070) 

(0.136) 

(0.107) 

Imagine 

-0.142 

-0.634** 

-0.217 

-0.008 

-0.294* 


(0.207) 

(0.303) 

(0.131) 

(0.148) 

(0.165) 

t*Imagine 

-0.079 

0.558 

0.095 

0.050 

0.163 


(0.203) 

(0.444) 

(0.159) 

(0.218) 

(0.169) 

Low student 

-1.183*** 

-1.352*** 

-1.221*** 

-1.039*** 

-1.499*** 


(0.165) 

(0.272) 

(0.155) 

(0.205) 

(0.170) 

t*Low 

0.269 

0.658** 

0.504*** 

0.841** 

0.668*** 


(0.186) 

(0.300) 

(0.146) 

(0.307) 

(0.190) 

Imagine *Low 

0.007 

0.595** 

0.400* 

-0.080 

0.279 


(0.269) 

(0.289) 

(0.205) 

(0.291) 

(0.196) 

t*Imagine*Low 

0.306 

-0.592 

-0.463** 

-0.237 

-0.280 


(0.277) 

(0.427) 

(0.219) 

(0.395) 

(0.246) 


0.329 

0.181 

0.295 

0.333 

0.422 


Panel A: 

End of Year Two (n=217) 


Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.724*** 

0.912*** 

0.804*** 

0.671*** 

0.972*** 


(0.154) 

(0.271) 

(0.105) 

(0.092) 

(0.158) 

t 

0.750*** 

0.042 

0.591*** 

0.515*** 

0.644*** 


(0.121) 

(0.194) 

(0.079) 

(0.125) 

(0.103) 

Dyned 

-0.142 

-0.634** 

-0.217 

-0.008 

-0.294* 


(0.207) 

(0.303) 

(0.131) 

(0.148) 

(0.165) 

t*Dyned 

0.284 

0.836** 

0.124 

0.192 

0.419* 


(0.224) 

(0.329) 

(0.194) 

(0.245) 

(0.211) 

Low student 

-1.183*** 

-1.352*** 

-1.221*** 

-1.039*** 

-1.499*** 


(0.165) 

(0.272) 

(0.155) 

(0.205) 

(0.170) 

t*Low 

0.451** 

0.703** 

0.480*** 

Q 

0.763*** 


(0.177) 

(0.298) 

(0.124) 

(0.302) 

(0.177) 

Dyned*Low 

0.007 

0.595** 

0.400* 

-0.080 

0.279 


(0.269) 

(0.289) 

(0.205) 

(0.291) 

(0.196) 

t*Dyned*Low 

-0.194 

-0.908** 

-0.204 

0.087 

-0.362 


(0.264) 

(0.405) 

(0.216) 

(0.397) 

(0.260) 


0.406 

0.222 

0.387 

0.470 

0.506 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the restricted sample of students without missing test score data at schools with English teachers from 
the original randomization. Standard errors, adjusted for school-level clustering, are presented in parentheses. * 
p<.l; ** p<.05; *** p<.01. 
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Table 6c: Effects of DynEd vs. Imagine for Low-Scoring Students 


Panel A: End of Year One (n=331) 

Variables 

Picture 

Verbal 

Understanding 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.819*** 

0.792*** 

0.821*** 

0.941*** 

0.761*** 


(0.130) 

(0.093) 

(0.101) 

(0.058) 

(0.100) 

t 

0.253** 

-0.350* 

0.051 

-0.013 

0.309** 


(0.125) 

(0.184) 

(0.085) 

(0.108) 

(0.122) 

DynEd 

-0.096 

0.358* 

-0.006 

-0.031 

0.030 


(0.163) 

(0.200) 

(0.150) 

(0.084) 

(0.148) 

t*DynEd 

0.461*** 

-0.339 

0.390** 

-0.073 

0.194 


(0.158) 

(0.333) 

(0.150) 

(0.179) 

(0.198) 

Low 

-1.688*** 

-1.420*** 

-1.646*** 

-1.499*** 

-1.594*** 


(0.142) 

(0.093) 

(0.117) 

(0.142) 

(0.141) 

t*Low 

0.867*** 

Q 992*** 

0.836*** 

1.106*** 

0.744*** 


(0.211) 

(0.179) 

(0.129) 

(0.143) 

(0.180) 

DynEd* Low 

0.150 

-0.358* 

0.013 

-0.054 

0.052 


(0.179) 

(0.200) 

(0.183) 

(0.178) 

(0.192) 

t*DynEd*Low 

0.040 

0.374 

0.307 

0.153 

0.258 


(0.279) 

(0.337) 

(0.223) 

(0.224) 

(0.271) 


0.589 

0.349 

0.512 

0.435 

0.549 

Panel B: End of Year Two (n=331) 

Variables 

Picture 

Verbal 

Understanding 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.819*** 

0.792*** 

0.821*** 

0.941*** 

0.761*** 


(0.130) 

(0.093) 

(0.101) 

(0.058) 

(0.100) 

t 

0.770*** 

0.152 

0.436*** 

0.406*** 

0.874*** 


(0.153) 

(0.142) 

(0.127) 

(0.122) 

(0.155) 

DynEd 

-0.096 

0.358* 

-0.006 

-0.031 

0.030 


(0.163) 

(0.200) 

(0.150) 

(0.084) 

(0.148) 

t*DynEd 

0.160 

-0.768*** 

0.116 

0.0271 

-0.053 


(0.210) 

(0.264) 

(0.182) 

(0.139) 

(0.198) 

Low 

-1.688*** 

-1.420*** 

-1.646*** 

-1.499*** 

-1.594*** 


(0.142) 

(0.093) 

(0.117) 

(0.142) 

(0.141) 

t*Low 

0.529*** 

0.597*** 

0.701*** 

1.191*** 

0.482*** 


(0.182) 

(0.152) 

(0.148) 

(0.152) 

(0.165) 

DynEd* Low 

0.150 

-0.358* 

0.0134 

-0.054 

0.052 


(0.179) 

(0.200) 

(0.183) 

(0.178) 

(0.192) 

t*DynEd*Low 

0.331 

1.006*** 

0.545** 

-0.200 

0.465** 


(0.236) 

(0.277) 

(0.233) 

(0.210) 

(0.226) 


0.623 

0.365 

0.577 

0.583 

0.621 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the full sample of students without missing test score data. Standard errors, adjusted for school-level 
clustering, are presented in parentheses. * p<.l; ** p<.05; *** p<.01. 
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Table 7a: Effects of Dyned vs. Control by Gender 



Panel A: 

End of Year One (n=249) 



Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Fanguage 

Constant 

0.254 

0.324 

0.344** 

0.258 

0.371** 


(0.151) 

(0.233) 

(0.154) 

(0.180) 

(0.165) 

t 

0.551*** 

0.050 

0.357** 

0.503** 

0.478*** 


(0.162) 

(0.311) 

(0.145) 

(0.216) 

(0.149) 

Dyned 

0.002 

-0.179 

-0.140 

-0.008 

-0.101 


(0.229) 

(0.317) 

(0.263) 

(0.209) 

(0.253) 

t*Dyned 

0.510** 

-0.008 

0.565** 

-0.020 

0.399* 


(0.222) 

(0.377) 

(0.229) 

(0.244) 

(0.224) 

Female 

-0.050 

0.036 

-0.097 

-0.043 

-0.053 


(0.197) 

(0.192) 

(0.178) 

(0.164) 

(0.171) 

t*Female 

0.149 

0.073 

0.145 

0.228 

0.189 


(0.166) 

(0.297) 

(0.198) 

(0.229) 

(0.175) 

Dyned*Female 

-0.017 

-0.041 

-0.066 

-0.099 

-0.073 


(0.269) 

(0.318) 

(0.267) 

(0.196) 

(0.254) 

t*Dyned*Female 

-0.405 

-0.079 

-0.128 

-0.116 

-0.243 


(0.313) 

(0.425) 

(0.260) 

(0.257) 

(0.276) 


0.159 

0.011 

0.139 

0.116 

0.132 


Panel A: 

End of Year Two (n=249) 



V ariables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Fanguage 

Constant 

0.254 

0.324 

0.344** 

0.258 

0.371** 


(0.151) 

(0.233) 

(0.154) 

(0.180) 

(0.165) 

t 

0.898*** 

0.342 

0.710*** 

0.862*** 

0.910*** 


(0.140) 

(0.257) 

(0.082) 

(0.230) 

(0.146) 

Dyned 

0.002 

-0.179 

-0.140 

-0.008 

-0.101 


(0.229) 

(0.317) 

(0.263) 

(0.209) 

(0.253) 

t*Dyned 

0.267 

0.089 

0.307 

-0.039 

0.236 


(0.233) 

(0.355) 

(0.199) 

(0.250) 

(0.216) 

Female 

-0.050 

0.036 

-0.097 

-0.043 

-0.053 


(0.197) 

(0.192) 

(0.178) 

(0.164) 

(0.171) 

t*Female 

0.076 

-0.009 

0.154 

0.072 

0.101 


(0.147) 

(0.347) 

(0.145) 

(0.299) 

(0.222) 

Dyned*Female 

-0.017 

-0.041 

-0.066 

-0.099 

-0.073 


(0.269) 

(0.318) 

(0.267) 

(0.196) 

(0.254) 

t*Dyned*Female 

0.084 

0.025 

0.046 

0.026 

0.060 


(0.208) 

(0.461) 

(0.226) 

(0.346) 

(0.271) 


0.257 

0.032 

0.228 

0.227 

0.254 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the restricted sample of students without missing test score data at schools with English teachers from 
the original randomization. Standard errors, adjusted for school-level clustering, are presented in parentheses. * 
p<.l; ** p<.05; *** p<.01. 
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Table 7b: Effects of Imagine Learning vs. Control by Gender 


Panel A: End of Year One (n=217) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.254 

0.324 

0.344** 

0.258 

0.371** 


(0.152) 

(0.233) 

(0.155) 

(0.181) 

(0.166) 

t 

0.551*** 

0.050 

0.357** 

0.503** 

0.478*** 


(0.162) 

(0.312) 

(0.146) 

(0.217) 

(0.150) 

Imagine 

-0.230 

-0.403 

-0.114 

-0.093 

-0.253 


(0.229) 

(0.268) 

(0.261) 

(0.257) 

(0.235) 

t*Imagine 

0.148 

0.536 

-0.116 

0.056 

0.157 


(0.183) 

(0.381) 

(0.247) 

(0.283) 

(0.194) 

Eemale 

-0.050 

0.036 

-0.097 

-0.043 

-0.053 


(0.198) 

(0.192) 

(0.178) 

(0.164) 

(0.171) 

t*Eemale 

0.149 

0.073 

0.145 

0.228 

0.189 


(0.166) 

(0.298) 

(0.198) 

(0.230) 

(0.176) 

Imagine*Eemale 

0.187 

0.046 

0.127 

0.105 

0.156 


(0.233) 

(0.211) 

(0.274) 

(0.226) 

(0.227) 

t*Imagine*Eemale 

-0.187 

-0.465 

0.055 

-0.192 

-0.210 


(0.207) 

(0.371) 

(0.340) 

(0.331) 

(0.251) 


0.102 

0.026 

0.053 

0.129 

0.099 


Panel A: 

End of Year Two (n=217) 



Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

0.254 

0.324 

0.344** 

0.258 

0.371** 


(0.152) 

(0.233) 

(0.155) 

(0.181) 

(0.166) 

t 

0.898*** 

0.342 

0.710*** 

0.862*** 

0.910*** 


(0.140) 

(0.258) 

(0.082) 

(0.231) 

(0.146) 

Dyned 

-0.230 

-0.403 

-0.114 

-0.093 

-0.253 


(0.229) 

(0.268) 

(0.261) 

(0.257) 

(0.235) 

t*Dyned 

0.313 

0.608* 

0.139 

0.308 

0.407* 


(0.232) 

(0.334) 

(0.233) 

(0.297) 

(0.233) 

Eemale 

-0.050 

0.036 

-0.097 

-0.043 

-0.053 


(0.198) 

(0.192) 

(0.178) 

(0.164) 

(0.171) 

t*Eemale 

0.076 

-0.009 

0.154 

0.072 

0.101 


(0.148) 

(0.348) 

(0.146) 

(0.300) 

(0.222) 

Dyned *Eemale 

0.187 

0.046 

0.127 

0.105 

0.156 


(0.233) 

(0.211) 

(0.274) 

(0.226) 

(0.227) 

t*Dyned*Eemale 

-0.222 

-0.321 

-0.190 

-0.158 

-0.279 


(0.241) 

(0.405) 

(0.336) 

(0.325) 

(0.299) 


0.209 

0.061 

0.177 

0.301 

0.246 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the restricted sample of students without missing test score data at schools with English teachers from 
the original randomization. Standard errors, adjusted for school-level clustering, are presented in parentheses. * 
p<.l; ** p<.05; *** p<.01. 
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Table 7c: Effects of DynEd vs. Imagine Learning by Gender 


Panel A: End of Year One (n=331) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

-0.136 

-0.175* 

0.001 

0.033 

-0.081 


(0.145) 

-0.096 

(0.184) 

(0.163) 

(0.162) 

t 

0.826*** 

0.505*** 

0.572*** 

0.701*** 

0.825*** 


(0.119) 

(0.156) 

(0.161) 

(0.148) 

(0.123) 

DynEd 

0.204 

0.216 

0.124 

0.065 

0.187 


(0.209) 

(0.195) 

(0.252) 

(0.203) 

(0.230) 

t*DynEd 

0.344* 

-0.332 

0.367* 

-0.153 

0.147 


(0.172) 

(0.241) 

(0.216) 

(0.178) 

(0.185) 

Eemale 

0.065 

0.104 

0.003 

-0.105 

0.022 


(0.137) 

-0.094 

(0.156) 

(0.168) 

(0.136) 

t*Eemale 

-0.190 

-0.414** 

-0.200 

-0.006 

-0.243 


(0.144) 

(0.159) 

(0.197) 

(0.184) 

(0.150) 

DynEd*Eemale 

-0.214 

-0.115 

-0.297 

0.029 

-0.213 


(0.207) 

(0.218) 

(0.237) 

(0.195) 

(0.212) 

t*DynEd*Eemale 

0.099 

0.397 

0.368 

0.127 

0.308 


(0.259) 

(0.307) 

(0.269) 

(0.204) 

(0.249) 


0.237 

0.024 

0.164 

0.117 

0.199 

Panel A: End of Year Two (n=331) 

Variables 

Picture 

Verbal 

Und. 

Story 

Oral 

Vocabulary 

Analogies 

Directions 

Recall 

Language 

Constant 

-0.136 

-0.175* 

0.001 

0.033 

-0.081 


(0.145) 

-0.096 

(0.184) 

(0.163) 

(0.162) 

t 

1.182*** 

0.741*** 

0.821*** 

1.180*** 

1.238*** 


(0.116) 

(0.156) 

(0.142) 

(0.153) 

(0.123) 

DynEd 

0.204 

0.216 

0.124 

0.065 

0.187 


(0.209) 

(0.195) 

(0.252) 

(0.203) 

(0.230) 

t*DynEd 

0.072 

-0.332 

0.216 

-0.204 

-0.020 


(0.190) 

(0.254) 

(0.208) 

(0.186) 

(0.182) 

Eemale 

0.065 

0.104 

0.003 

-0.105 

0.022 


(0.137) 

-0.094 

(0.156) 

(0.168) 

(0.136) 

t*Eemale 

-0.233 

-0.391** 

-0.070 

-0.017 

-0.214 


(0.149) 

(0.157) 

(0.173) 

(0.159) 

(0.149) 

DynEd*Eemale 

-0.214 

-0.115 

-0.297 

0.029 

-0.213 


(0.207) 

(0.218) 

(0.237) 

(0.195) 

(0.212) 

t*DynEd*Eemale 

0.424** 

0.336 

0.397* 

0.002 

0.390* 


(0.197) 

(0.277) 

(0.237) 

(0.213) 

(0.203) 


0.291 

0.057 

0.230 

0.287 

0.301 


Test scores are standardized restricted sample control group baseline test score means and standard deviations. This 
analysis uses the full sample of students without missing test score data. Standard errors, adjusted for school-level 
clustering, are presented in parentheses. * p<.l; ** p<.05; *** p<.01. 
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